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ABSTRACT 

This evaluative report consists of two parts. The 
first is a narrative report which represents a summary by the 
evaluation team and recommendations regarding project activities ; the 
second part provides a statistical analysis of project achievements. 
Details are provided on evaluation techniques, staff, management, 
instructional materials, activities, community involvement, and 
external problems. The second part involves component analyses and a 
quantitative study of program achievement. (VM) 
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PROJECT SELL 
EXTERNAL EVALUATION 

Project Year 1970-197 1 - 

FINAL REPORT 



OVERVIEW 



The following is the Final Evaluation Report for Project SELL 1970-71 sub- 
mitted by Dr. Eliane C. Condon to Mrs. Doris Wadsworth, Director, Project SELL, 
and based on the 1970 Evaluation Design submitted in June 1970 by the Principal 
Consul tant . 

This report consists of two parts: first a narrative report which represents 

a summary by the evaluative team and recommendations regarding SELL activities; 
and second, a statistical analysis of project achievements. 

Part I of this report is organized in accordance with Standard Guidelines for 
Narrative Evaluations (Form EC 1-0-1; January 1971)- It includes both product and 
procpss assessment since all component processes (except for teacher training) 
continue throughout the entire project year. In. fact, both the Maintenance and 
Affective functions of the director cannot be evaluated until the end of the year. 
Since all necessary objective forms have not been developed as yet (as Well as 

pre-tested and evaluated), findings discussed in Part I are based upon both objective 

and subjective data (See details in report). However, it should be kept in mind that 

all subjective judgements are based upon the extensive involvement of evaluative team 

members in project activities and that they are objectified by the concurrence of 
assessments made by a panel of five experienced educators. 

A Gestalt assessment of Project SELL activities, made as a result of 38 on-site 
visits to Project SELL (made by the Principal Consultant, see details on page 2, 
paragraph 1), which included detailed periodical examinations of documentary evidence, 
frequent conferences with staff and observations of project activities, and sub- 
stantiated by the results of statistical analyses^ (aee Part II of this report) 
will establish the framework of bilingual education in Union City, New Jersey. On 
these bases, the following conclusions may be drawn: 

a. Bilingual education in Union City is producing cognitive and affective 
gains in project participants (both staff and pupils). 

b. Educationally and culturally relevant materials are being developed 
and constantly being refined in Roosevelt School. 

c. American and Cuban parents are supportive in their attitudes and 
behavior toward bilingual education as offered in Project SELL. 

d. Management problems may be expected to continue as a result of 
the need to reconcile divergent streams of community interests, 

Board of Education policies and 0E Title VII requirements. 
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PROJECT SELL 



EMTSiiNAL EVALUATION 

*xr 



Project Year: 1970-191 
Scheduled Activities 



EVALUATION activities 



; CoheSfo ea 



Comments 



•: i, 



Periodic Invo lvement in all Project 
Ac-: ivities : 



; Advisory function 


13 


as needed 


; Personnel Training 


10 


on time 


i iiaterials .Development 


10 




; Evaluation 


15 


as needed 


i E3L Specialist (Master teacher Summer 


1970) 




| Personnel training " 


30 days 


on time 


\ Evaluation Follow-Up 


10 days 




£ 

i Spanish Specialist (Master T. Sumner 


1970) 




• Personnel Training " 


30 days 


on time 


j Evaluation Follow-Up 


17 days 


as needed 


! Bilingual Education Specialist 






! Evaluation 


16 days 


as needed 


Nongrad ed Education Specialist 






I Personnel Training 


10 days 


on time 


| Evaluation 


10 days 


as needed 


J Human Relations Specialist 






i Personnel Training 


15 days 


on time 


Evaluation , . 


10 days 


as needed 


Human Relations Comp. (1971/72 Prop.) 


14 days 


on time 


i Psychometrist 






j Quantitative Evaluation 


11 days 


as needed 


j Evaluative Instruments Development 


4 days 


as needed 


! 2. Feedback at Regular Intervals 






i Team Meetings (3) 


Oct. 20 


Nov, 19, 


• 


Jan. 5 


called o 


k .. _ 


Apr. 15 


Apr. 23, 



Individual Conferences with staff 
(on-site) 



Unscheduled meetings : 

Periodically 



Telephone consultation 



Written Reports: 

a. Individual Reports (5) 



Integrated Report //l 



Integrated Report 





As needed 


i — 1 


Sept. 15 


trl 


Oct . 1 


7/2 


Jan. 5 


/A 2 


Jan. 20 
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71 



July 29, 70 



AUg, 



8, 70 

With each visit to project 



At least once a month 



9 on time 



1 late (Oct.l); 1 missing 



Nov. 1 



(}.ate receipt o: 
2 reports) 



canceled School problem 



i 



g. Individual Reports (5) 


0 


Ju. 29 


Integrated Report 




Unscheduled 



Final Report with quantitative 
data . Aug. 13 



3. Verification of Fro reran Objectives 

Rewriting of Objectives 

(in compliance 'with OE requirements) No date 

\ 

Review of new Objectives Periodically 



Re-formulation of Objectives 

(for new proposal) Apr. 30 

Assignment of Priorities Continuous 



; 4. Verif ication of Overall Destine; Plan 

; Review of Pre-testing (1970) No date 

Pec' ommenda t ions on control groups 

" on comparison testing 

] New testing plan (new proposal) Apr. 30 



i 5. Development of Evaluativ e Instruments 

| A total of 26 instruments were 

j developed during the year and are 

I in the process of being revised. No date 
(No specific quantity had been 
I planned) 



j 

I 6 . assistance in Workshops & Project Pres ent at ions 
Second Language Learning Workshop Summer 70 
Human Relations Workshop " 

Materials Development Workshop Continuous 



Project Presentations As needed 



i 7. Overall Data Analysis & interpretation 

— 

! : All Pre- and Post-test data to be 

collected by Internal Evaluator 
and to be interpreted by External 
Evaluator in final report Aug. 13 71 



Apr. 23 Needed for new 
T>roposul 

All submitted but 1 

Team report submitted on 
April 23 after meeting on 
new proposal 



Nov. 24 Special circumst. 
(See Narrative 
•Report, p. 10-15) 



Oct. 1, 70 

On time (each on-site 
visit) 



On time 

On basis of need 
Nov. , 70 



On time 



June 30, 1971 



On time 



On Time 

periodic Visits 
(Principal Consultant) 
Upon request by Director 
(Principal Consultant) 



(Special 

Circumstances - 
Nov. 24 See Narrative 

Report, p 10-1 5 ) 



ALL ABOVE ACTIVITIES PROPOSED AS OP June, 1970; finalized and submitted in 
I Official Evaluative Design on July 31> 1970; Approved as addendum to official 
■' (j r ' r? 0 -l 971 proposal. 

EMC . S 



'Tile data available to the principal consultant on the 1970-1971 
Project SELL year may be classified into three categories, as follows: ■] 

1. Documentary livid once (Objective data) j 

All evaluative results j 

Records of observations j 

Director's daily log of activities ] 

i'iinutes of meetings , j 

Financial records 

Personnel credentials j 

Project-developed instructional materials i 
Project-developed evaluative instruments ! 

All project files . 

Videotapes and analysis 
Recorded pupils' voices 

Historical and current data on Roosevelt school and the 
Union City Public Schools (demographic surveys, pupil records,! 
statistics and the like) ' , 

Communications from ESI-/ and auditor '■ 

Individual evaluation reports 

2. Personal Observation (Subjective data) 



a. Participant Observation of the following Ongoing Activities: 

Director: assessing program needs 
interviewing personnel 
assigning roles and responsibilities 
scheduling specific tasks 

evaluating personnel performance | 

locating resources j 

planning evaluation 1 

collectinfg and organizing information i 

arranging for feedback I 

planning component activities j 

relating to Board of Education, HEv/ and aiiditor .1 
Dealing with emergencies j 

reconciling contra ints j 



.internal Evaluator: reviewing evaluative instruments 

planning internal evaluation 
administering tests 
evaluating teacher performance 

" materials development 
interpreting results 
arranging for feedback 

Associate Director: Organizing community activities 

training and supervising teachers 
supervising materials development 
collectinG; and organizing community 
data 

assisting director 

Plaster Teachers: demonstrating bilingual techniques 

supervising lesson planning 
observing trainee performance 



i 
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relating theory to classroom practice 
evaluating trainee performance coopera- 
tively 

providing follow-up recommendations. 

Other Personnel: (Among other tasks) 

developing materials 
reviewing existing materials 
planning instruction 
performing self-evaluation 
relating to administrators, colleagues, 
observers, parents and children 

b. Conferences and Interviews with Individuals 

Hr. P. Zuccaro, Superintendent of Union City Schools (3) 

Hr. K. Simon, Vice-Superintendent (8) 

Hr. R. Lanni , Chairman, School Board (2) 

Hr. J. Marini, principal, Ho os eve It School (5) 

Mrs. 0. LaHosa, ITongraded Supervisor, Jioosevelt School (4) 
Mrs. 72. Suris , Guidance Counselor (periodic, summer) 

Project S75LL -teachers and staff members (periodic) 

Ho os eve It School children (15 children)- random sample 

(Note: the principal consultant did not visit community 
members on a one-to-one basis, but had occasion to 
observe their reactions at various community functions, 
as well as on the occasions of their numerous visits to 
Hoosevelt school during the summer. It was felt that 
Dr. Arguelles, a sociologist of Cuban origin, would relate 
better to the community than anyone else). 

Members of Evaluative learn (Group meetings - 2; Individual 
meetings 4 each) 

Dr. V. Jiorner (Yeshiva) - concerning materials (2) 

Hr. 'I. Gaynor (3), Publicity & Public Relations 

All documentary evidence listed under paragraph (1) and examined 

by the principal consultant are available to anyone involved in 

project ZELL. Findings based upon these data have been organized, 

analyzed and interpreted statistically by the external evaluator; 

these findings are reported in Part II of this final report. 

COhTQNSNQ? EVALUATION 

1. Staff Development 

Personnel selection, orientation, training and supervision 
seems to present no difficulty in project SELL, as one may judge from 
a low rate of attrition (one administrator — associate director; and 
2 teachers out of a total of 17 individuals. 
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Product : J ersonnel training occurs mainly during the summer 
institute, v.'ith a supervisory follow-up through tie academic 
year. Gains in teaching performance are reported in Part XI 
of this report, Altitudinal changes cannot be reported 
objectively on the basis of collected data. The Purdue Beale , 
of attitude has not been found appropriate to the needs of the 
bilingua 1-bicultural program situation. An attitude survey 
is being developed at the present tine. 

On the basis of teacher oDservatioir and interviews(See Pages 
2 and 3 for number of days), it is suggested that crosscultura! 
interaction of "American" and "Cuban" teachers be. organized 
by the director ona regular basis to promote bicultural j 

experiences for the staff. Such topics could be discussed: j 

teacher-pupil interaction patterns, subject matter handling, j 
behavioral objectives, and the like. j .. : 



! 



Process : The effectiveness of the- training process is evidence.; 
in two ways: first, the analyzed lire suits of observation report j 
and videotapes *, second, the demonstrated success of the j 

training format after which the '(institute is patterned (the 
Harvard University HAT program (how in existence for some 
twenty years).. One of the first teachers trained in Union Git; 
under this system has now become project SELL's bilingual 
specialist; in addition, lirs. Hoscoe addressed the 1970-71 i 
TU20L conference to describe the activities of project SELL, j 
This year, the principal consultant has received three request] 
for enrolment in a Bilingual or SSL doctoral, program. These •! 
tend to indicate that the project has succeeded in instilling j 
a positive attitude and interest in bilingual education, i 

within some of -the trainees. Ouring the year 10. teachers did ) 

attend SSL and bilingual courses given at nearby universities.! 
It is recommended that a survey be made this year of SELL j 
participants who are 1) taking relevant courses, or 2) ] 

taking courses leading to a relevant degree. During informal :■ 
interviews, teachers have expressed a sense of security in \ 
knowing how handle non-English speaking pupils , and have | 



training 



attributed this professional achievement to summer 
experiences. These statements we re confirmed by all master 
teachers. 



It is, therefore, recommended that training format be maintained^ 

■] 

but that behavioral objectives be refined (with appropriate criteria ; 
and evaluative instruments) in order to facilitate an objective J 

'i 

evaluation of product and process results. j 

2 . Instruction j 

•i 

The format, and objectives of nongraded bilingual instruction 
need to be re-examined in terras of specificity and feasibility. As 
indicated from the very beginning of the 1970-1971 academic year, 
the cognitive, affective and psychomotor gains of project SELL 
pupils need to be re-stated, criteria established, and appropriate 



7 



control groups selected, in order to permit an objective evaluation 




for the internal evaluator, as well as for the external evaluator, 
which would detail areas of responsibilities, types of data to be 
collected and submitted, and tine schedule for same. 



a. Pr o duct : Cognitive gains are reported in Part II of this 
report. Grosscultural interaction between native-born and 



Cuban-born children was not formally measured. Positive attitudes 
toward bilingual education are intermingled with the effects of 
nongraded education; these combined affective goins are reported 
in Part II of this report. 

b. Process : (There is no evidence to indicate the superiority of ! 
a single bilingual teacher or a bilingual team approach (one ESL i 
specialist; one Spanish specialist) to handle biiingual education j 
at Roosevelt school. Too many variables enter into this situation 
to allow a valid comparative study of these approaches : teacher 
personality, subject matter knowledge, language teaching 
competency on the onehand; grade level, nongraded format, 
instructional scheduling on the other; and finally individual 
differences in the pupils, ranging from language aptitude and 
motivation to socio-economic background and previous learning. 
However, the practice of collecting English-speaking pupils at \ 
specific times during the day for Spanish instruction seems j 

impractical (time-consuming and disruptive in terms of learning j 
experiences). It is apparently rendered necessary by two factors: j 
first, the diminishing number of English-speaking pupils at j 

(Roosevelt school; second, the nature of nongrading which disperses ! 
students throughout different levels of achievement. The j 

■writer does not recommend the elimination of nongrading which I 

individualizes learning experiences for all participants on the I 
basis of language proficiency skills (which are the keys to \ 

subject matter learning). It is suggested that other methods ■ 

of bringing children together be explored. '] 

. i 

In addition to CIA and Eoelim tests, the following data should I 

be collected for evaluation: statistics on pupil turnover, absenteeism,] 

, ' j 

levels progress and crosscultural interaction patterns. j 



of this report. Twenty-six evaluative instruments were developed 



remainder is being reviewed for use in the 1971-1972 project year. 
Instructional materials will be evaluated qualitatively this year, 



3. Materials Development 



Quantitative data on bilingual materials are available in Fart II 



throughout the 1970-1971 project year and six were rejected *; the 



ERIC 



after a one-year trial; a survey questionnaire has already been 



(*non-graded check lists) 
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distributed to teachers who have used then. A qualitative rating 
will also be made by the external evaluator. An "excellent" rating 
has already been assigned to the E3L Learning sequence by Dr. Vivian I 

Horner from Yeshiva University who recommended funding for expanded j 

j 

i 

development of the Spanish sequence by the National Consortia Agency j 

i 

in Texas . ) 

a. Product: See Part II for quantitative listing. Regarding J 

contents, there seems to be a need for reviewing the revised j 

Si'TL sequence once more (this version does represent a considerable! 
improvement over the initial one which turned out to be a straight) 
translation from the ENL sequence). This version is based upon 
the nature of the Spanish language, but it needs better pacing 

and other minor adjustments such as less generality in instruction 
Acculturative techniques also need to be spelled out in some 
details. : 

b. Process : The involvement of native-born and Cuban-born teachers 

under the supervision of a bilingual specialist seems to be an ! 
effective means of producing b il ingual-b ic ultura 1 instructional > 
materials. It is recommended that the director and bilingual j 

consultant spend tine with materials developers whenever they \ 

start working on a new sequence. This may eliminate the I 

"translation" problem which occurred in the 3NL sequence. 

It is recommended that a complete set of bilingual materials be 

kept at the administrative office and that they be color-coded for 

easy retrieval. a resource center of such materials, as well as j 

reference texts, sample tests and the like should be created at ] 

Roosevelt school, with duplicates in the office. j 

j 

. \ 

A. Community Invo lvemont I 

i 

A Community Survey was undertaken, data collected and organized 

by Dr. Maria Argue lies Canive during the project year. No report J 

’t 

has been suomitted by this evaluator upto the present. ’ A mini-eval- A 
uation has been performed on available community information; it is J 
submitted in Part II. 

5 . Dissemination 

Both community involvement and dissemination are interrelated; | 
there seems to be a need for greater dissemination of information on J 
project SELL throughout the community and the State of New Jersey. | 

'■I 

% 











t 



■' 1 * 



Spot checkins by the principal consultant on the streets of Union 

City, at the HJ3A conference .in Atlantic City and in the Schools of 
' ’ * ** . » 

.Education of Newark State UbTlege, ilontclair State College', Jersey City. 

\ r , t 



^Itat^jpollege , Rutgers University and Fairleigh Dickinson University j 



' . t 



■r e\te: 



>.t project 3 SI-Jj activities are not yet sufficiently public 



i^edj 






*. 



despite*, nimerous articles in local newspapers. 
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a. ‘ Product : A list of dissemination data and activities is 
appended herewith. The quantity and diversity of these it eras 

seems impressive as the results of a first year of operation. 

; 

! ?.-■ 

b. ( process : The process of dissemination so far has consisted 
ofJ : fetters sent to Hew Jersey superintendents, indicating the 
availability of materials, speeches made by the director, 
nethipaper contacts, advisory meetings, board meetings and the 
lille It would seen advisable to establish specific plans for 
diasejni nation on tvro levels: i nternal communication to 
facilitate a two-way flow of information between BELL 
administrators, participants and consultants; and external 
communication to involve more closely educational agencies (03, 
St&te Department of Education, evaluator, auditor and Hew Jersey 
communities with project activities. Lines of communication 
appear to have been weak in the past. 

1 iiW.' 

ItflLs recommended that specific plans and procedures be devised 



s) 

by the. hm'rec.tor for the establishment of an effective network of 

V xtv-: r t 



c ommuh:;:i,4'iti ionj which will insure the production of feedback information. 

? u ! . ! 



6..' ( r:';'lan a gement 1 , 
. 'v:i ? — r , 



Tlqej operation,.. .'of apy first-year project involves a great deal 

•I 1 

of frustrating experiences and trial- and- error contingencies. Project 
SELL is- no exception in this respect. In terms of product, the overall 
quality of the program is a strong evidence of competent management 

(See jFart II statistics). The director, Mrs. Wadsworth succeeded in 

/ 

coping with whatever problem situation she encountered, and in 

i ; 

establishing a sound basis for bilingual education at Roosevelt School. 1 

In terms of process, the strengths and weaknesses of management 
functions are reflected in the data sheets appended herewith: 

Management Profile (By Functions), Management Profile (By Systems), 
Table I (Functions data),, Table II (Systems data), and Management 



Hating Scale sample (Form;3C5). Tables i and II represent data 



i± 
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based on three separate management ratings — one by the principal 
consultant, one by hr. John O'iTc-ill, and one by Hr. J. Bongo, These 
evaluators were selected in view of their periodic involvement with 
Project BILL , more specifically with the director. 

The functions Profile indicates a steady improvement of managerial 
effectiveness: zero rating is eliminated in operational, maintenance 
and affective functions; one rating is steadily reduced in favor of 
two and three ratings. Hating, thus, increases in excellence. 

The Systems Profile reveals the greatest area of weakness in the 
Communication System (15/6 excellent) and the greatest area of strength 
.in Training System (35 7o excellent). These data should help the 



director identify problem areas and suggest directions in which 
action is needed. 

In .order, to obtain a more diversified picture of management 
effectiveness, it is recommended that the director and her staff 
use the hating Scale attached herewith, in addition to the external 
evaluator and that results be analysed statistically. 

In conclusion, the writer' would like to point out that several 
factors rendered an external evaluation difficult to perform. They 
may be listed as follows: 

A. External Problems (Union City Public Schools ) 

1. Teacher strike in mid-year; preceded by period of unrest during j 

negotiations. Prevented on-site observation of instruction and 1 

teaching performances. f 

2. Appointment of new Board of Education in January 1971* Necessitated \ 

expenditure of time on the part of SELL staff members to inform new 

Board members of SELL activities. Delayed the appointment of SELL 
staff members, as well as the approval of SELL requests (ex: replacement 
of duplicating facilities).- 

3. Due to Board of Education delay in receiving 0E funds, salaries of 

SELL personnel were withheld in September and disbursed at a later I 

date. This created a climate of insecurity resulting in a lowering 
of personnel efficiency. It also required time-consuming negotiations 
on the part of the director with the Board (time taken from normal 
management functioning). 

k. Lack of comprehensive guidelines, for Evaluator and Auditor roles \ 

and responsibilities in 1970. 12 1 



/ 
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B, Internal Problems (SELL) 

1. Late appointments: Mrs. C. Roscoe - Bilingual Specialist. Delayed 

materials production and impaired SELl-school- 
communi ty communication. 

Mrs. E. K|-i tsidimas - Administrative Assistant. 
Impaired effectiveness of data organization and 
record keepi ng. 

2. Illness: Mrs. 0. Galagarza, Associate Director. Ill health throughout 

the year reduced her effectiveness in discharging her 
administrative and supervisory duties. She left in April 
and was not replaced. 

It should be noted that the responsibilities assigned to Mrs. Roscoe, . 
Mrs. Kritsidimas and Mrs. Galagarza were assumed by the director, 

Mrs. Wadsworth, the internal evaluator, Mrs. Seoane, with the support 
of external consultant-evaluators. This affected both management 
and evaluative operations. 

3. Secretarial Problem: the director's secretary proved incapable of 

handling her duties (monolingual; no training in administrative 
work). Her removal and replacement represented a problem since she 
held tenure as a city employee. The inadequacy of her work required 
weeks of review and verification on the part of the administrative 
assistant. 



C. Evaluative Team Problems 

1. Illness: Mr. Bongo, Nongraded Consultant, was hospitalized during the 

year and was unable to space his on-site visits evenly throughout the 
year. His final report was, consequently mostly subjective, since he 
found himself unable to examine objective data at that time. 



Mrs. T. Tetenbaum, psychometri st, suffered a physical 
collapse at the time data should have been analysed. She had to 
replaced by someone else. (This delayed analysis). 



be 



2. Family difficulties: the principal consultant's mother passed away 

during the summer, thus necessitating two prolonged visits to Europe, 
at a time when the final report should have been prepared. 

3. Nonf ul fi llment of oblications: Dr. M. Arguelles-Canive was unable to 

participate in this summer's training institute; thus requiring her 
replacement by the principal consultant (at a time which should have 
been devoted to the final report preparation). This same consultant in 
Human Relations has not submitted written reports on the community 
participation component. The completion of a final report was held 

in the hopes of receiving the data collected and analyzed by Dr. Arguelles. 
To date, nothing has been received. 

One of the major problems in evaluation has been inherent to the satellite format 
of the evaluation, with a team leader responsible for the overall performance of 
the work, but without any authority to demand adherence to accountability standards, 
or means of enforcing same. As a result of this situation, one report has never 
been submitted and, of the other four individual reports submitted by other 
evaluators, two did not conform either to the proposed Guidelines for Evaluation 
Report (Form EC 1-0-1) or to accountability requirements of objectivity. 



A solution to this problem has been proposed to SELL administrators and the 
Board of Education and a proposed contract submitted by an external agency to 
handle the entire evaluation. Under this contract, specifications for specific 
tasks to be performed by the internal evaluator, external evaluator and the 
auditor will be spelled out in detail. 

It should be pointed out, however, that the external factors which interferred 
with the course of management and evaluation activities, did not affect 
adversely the achievement progress of project components, such as staff 
development, pupil instruction, materials development and community involvement, 
as may be evidenced by the statistical results presented in Part II of this report. 
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TABLE I 



ihlNAGEiiENf DATA BY FACTIOUS 



PGHCPIOFS 



TOTAL ITEMS 



ACTINGS 
3 2 1 



0 



psrceittag: 



Systems Analysis 

Activation 

Operational 

Maintenance 

Affective 


34 

60 

60 

60 

48 


40 

23 

34 

32 


26 

23 

22 

16 


16 

7 

4 

0 




2 

2 

0 

0 


48-31-19- 2 

47-38-12- 3 

56-37- 6 - 0 
47 -50- 3 - 0 
66-34- 0- 0 


ITote: Percentages are graphically represented 

TABLE II 

I-LUTAGBMENT DATA 3Y SYSTEMS 

SYSTEMS TOTAL ITEMS , R ^' J?I1 ' IG 

9 * 2 


in i 

i 

ro 

i 


ianagement Profile A 
0 PERCENTAGES 


Personnel 


78 


11 


5 


3 




2 








7 


6 


2 




0 








11 


4 


0 




0 








5 


10 


0 




0 








12 


O 


0 




0 








46 


25 


5 




2 


59-52- 6- 3 


Communication 


78 


0 


11 


10 




0 








2 


S 


3 




2 








1 


11 


3 




0 








3 


10 


2 




0 








3 


7 


0 




0 








11 


4 7 


18 




2 


15-59-23- 3 


Training 


78 


16 


4 


1 




0 








11 


4 


0 




0 








15 


0 


0 




0 








15 


0 


0 




0 








9 


T f 

o 


0 




0 








66 


11 


1 




0 


85-14- 1- 0 


Resources 


78 


13 


6 


2 




! o 








8 


5 


2 




\ 0 








8 


7 


0 




0 








5 


10 


0 




0 








6 


6 


0 




0 








1 40 


34 


4 




0 


51-44— 5- 0 



p 

p- 



Hote : Percentages are graphically represented in Management Profile B 
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COMMUNITY EVENTS 



Date 


Event: 


Place 


Partici pants 


3/13/70 


Sunsrusr Graduation 


Roosevelt School 


Students in Project SELL 
program anc! parents 
+500 


10/26 to 


SSL sn ' ESI class 




1 0/30/70 


visi ts 


Roosevelt School 


Advisory Committee 


1 1/12/70 


Mrs. V/ads worth spoke. 


Roosevelt School 


+200 parents 




to parents' about SET! 


L 


- 


11/17/70 


Mrs. Wadsworth spoke Hudson School 
to PTA about SELL 


+100 parents 


11/13/70 


Di cultural Seminar 


Washington School 


37 teachers and adults 
SSL class 


, 11/10/70 


Bicultural Seminar 


Roosevelt School 


46 teachers and adults 
SSL class 


11/19/70 


Bicultural Seminar 


Roosevelt School 


31 parents and community 
members 


12/14/70 


Pot luck supper 


St. John's Lutheran 
Church 


+140 parents and 
communi ty members 


1/26/71 


Bicultural Seminar 


Court Chambers, U.C, 


, Community and parents 

/ 


1/27/71 


Bicultural Seminar 


Washington School 


Teachers and sdult SSL 
class 


1/27/71 


Bicultural Seminar 


Roosevelt School 


Bilingual teachers and 
adult SSL class 


1/23/71 


Jose Marti Day 


Jose Marti Statue +25 parents, teachers, 

54th Street and Park community 
Boulevard East 


2/24/71 


Presentation of 




Adult SSL students. 


2/24/71 


SSL certificates 


Washington School 


teachers and 
superintendent 


Presentation of 
SSL certificates 


Roosevelt School 


Adult SSL students, 
teachers and 
superintendent 


3/16/71 


Children's mid=yaar 
f i esta 


Roosevelt School 


+300 chi Idren, parents 
and teachers 


3/24/71 


Fashi on Show 


St. Augustine's 
Church Hal 1 


+500 parents, teachers 
and communi ty 


4/26 to 


SSL and ESL class 


Roosevelt School 


+25 parents 


4/30/71 


vi sits 




4/29/71 


Children's mid- y«»ar 
fiesta 


Edison School 


+100 children, parents 
and teachers. 



n . 

o 

ERLC 



Advisory Committee Meetings 



Date 


Place 


Participants 


0/6/7 0 


Roosevelt School 


9 


9/2V70 


m 11 


12 


10/22/70 


n n 


12 


11 / 30/70 


n 11 


9 


1/14/71 


11 n 


9 


2/1 S/71 


Project Office 


3 


' 4/20/71 


n n 


10 


Other speaking 


engagements : by Director 





10 / 20/70 


Park Theatre, 3i cultural Music Festival 


10 / 21/70 


Roosevelt School PTA 


10/29/70 


\ 

Robert Waters PTA 


11/17/70 


Edison School - initiation of non-graded meeting with 
entire fatuity. 



1/1 e/70 


Roosevelt School PTA 


Materials for 


Di ssemi nation 



Project Proposals (1970/71, 1971/72) 

Brief Description of Project SELL 
Oral English Proficiency Tests 

Non-graded information booklet on Roosevelt School 
1970/71 Non-graded report on Roosevelt School 
Vi deo- tapes 

All bilingual and non-graded materials collected by Project 



_Form EC 1-0-1 



18 



STANDARD GUIDELINES FOR NARRATIVE EVALUATIONS 



I OVERVIEW - General statement on overall impression of observer concerning 

program achievements, 

1. Quality of resuits 

2. Effectiveness of processes 

3. Quality of affective climate 

4. Interaction effect of program components 

5. Effect of assigned priorities 

II BACKGROUND - General statement on baseline data (on program participants), 

avai lable to observer. 

1 . Type of data 

2. Completeness of data 

3. Sources of data 

4. Organization of data 

5. Interpretabi 1 i ty of data 



III COMPONENT ANALYSIS 

1. Components to be evaluated: 

a. Staff Development 

b. Pupil Instruction 

c. Materials Development 

d. Community Involvement 

e. Dissemination 

2. Component factors to be evaluated; 

a. Project Administration 

b. Program Achievements - 

- Cognitive 

- Affective 

- Participative 

- Unanticipated 

c. Testing Program 

3. Factor Aspects to be assessed: 

a. Products Obtained 

b. Processes Utilized 

IV SUMMARY - Brief review of noted strengths and weaknesses for each component. 

Recommendation for action. 

1 . Strengths of program component 

2. Weakness of program component: 

a. Problem 

b. Detrimental effect 

c. Possible cause 

d. Recommended action 

V CONCLUSION - General statement on program operation and redirection over 

next semester. 20 



« * 



JbEFIHITION OF TERMS 



I. 



OVERVIEW 



II. 



Results: Observable progress (or lack of it); both objective 

(measurable) and subjective (not measurable by test). 
Ex: attitudinal change may not always be readily 

measurable. 

Procedures used to obtain results. 

Emotional undertone of personnel relationships, as i t 
affects performances. 

Interaction of components: Gestalt effect of program components; how they 

affect each other's progress. 

BACKGROUND 



Process : 

Affective Climate 



Type of data: 
Completeness: 
Sources : 
Organization: 
Interpre tabi 1 i ty : 



Historical, current, other; documentary, interview. 
Quantity and quality; range, chronological spread. 
External, internal (to project); objective, subjective. 
Classification by component or other; cross reference . 
Clarity of contents, especially as regards "technical" 
data. 



III. ANALYSIS 



Components: 



Factors : 



Staff Development: 
Pupil Instruction: 



Pre- service, in-service training 
Instruction (theory) and workshops 
Bilingual contents 
Bi cultural contents 
Courses of study; Nongrading 
Materials Development: Subject Matter 

Range 

Auxiliary Materials 
Community Involvement: Advisory Board 

School -Communi ty activities 
Formal Instruction 
Sharing of materials developed 
Use of mass media 
Personal Appearances (staff) 



Dissemi nation: 



Admi ni s tra ti on : 



Achievements: 



Testi ng Program: 



Dynamics of everyday operations 
Capability to meet contingencies 
Ability to plan, implement, direct, 
communicate, adapt, evaluate 
Cognitive - learning gains 
Affective - crosscul tural under- 
standing 

Participative - percentage of parti- 
cipation, tie-in with 
other programs 
Extent of testing 
Appropriateness of tests 
Statistical treatment 



IV. 

V. 



Aspects : 

SUMMARY : 

CONCLUSION: 



Product: Mes;.u. cd achievements (of stated objectives) 

Process: Means of achieving stated objectives 

Self-explanatory 

Self-explanatory 
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gating: 11 :c client - thoroughly competent performance 

. pie rape - adequate performance; could be improved 

Lbsrj than kverug-c - inadequate performance; must be 

improved 

v ?ry poor - unac rentable performance 


el lent 


4 

to 

ji 

CO 


Cl 

cl* 

& 

t.j 

fj 

Si 

• 


r <; 

o 

o 












V . * ) 


1 .M U, I ' J 1 0 ..A CJU'L-U/JI.O 










I. Personnel 










1. 


priority needs assessment of roles and responsibilities 








] 


2. 


.'be view of available manpower (on-site) 








3 


5. 


“revisions for personnel alternatives 








1 

i 


4. 


Criteria for selection of personnel 








- — { 


5 • 


needs assessment for technical assistance 










s. 


Specifications for technical assistance personnel 










7. 


Scheduling for personnel selection 








J 

? 


III. Co- 


iraunicntion 










! 1. 


Priority needs assessment for c orrmunic at ion networks 










: 2. 


Peview of existing’ communication system 










3. 


Provisions for alternative channels 


r 

i 






4. 


Specifications for data collection and dissemination 








i 


5. 


.Scheduling for o o mmuni cation activities 








j 


6. 


Provisions for record keeping and feedback procedures 








i 


7. 


Provisions for evaluation checkpoints 








* 


:IiI. Training 








* 

i 

j 


1. 


Priority needs assessment for training activities 








“i 


1 2. 


leviev of existing training facilities 








i 


i 3* 


Provisions for training alternatives 










4. 


definition pf training objectives, criteria and evaluations 










5. 


Scheduling of training activities 










r~ 

o. 


Provisions for cooperative planning (all personnel) 










- 7. 


Provisions for evaluation checkpoints 










:IV. Facilities and' 'Resources 










1. 


Priority needs assessment for facilities and resources i 










i 2. 


Survey of existing resources ; 








- } 
■ 1 


| 3. 


Provisions for resource alternatives 




1 


i 

| 


! 4. 


Specifications for resource acquisition 




\ 


i 

.5 


| 5. 


Scheduling for resource acquisition 








i 

* 


; 6. 


Provisions for budget allocations 








| 


; 7. 

j 


Provisions for evaluation checkpoints 








1 
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